Transient Solutions of Markov Processesby
نویسنده
چکیده
منابع مشابه
A note on the Markov property of stochastic processes described by nonlinear FokkerヨPlanck equations
We study the Markov property of processes described by generalized Fokker–Planck equations that are nonlinear with respect to probability densities such as mean ,eld Fokker–Planck equations and Fokker–Planck equations related to generalized thermostatistics. We show that their transient solutions describe non-Markov processes. In contrast, stationary solutions can describe Markov processes. As ...
متن کاملThe method of fundamental solutions for transient heat conduction in functionally graded materials: some special cases
In this paper, the Method of Fundamental Solutions (MFS) is extended to solve some special cases of the problem of transient heat conduction in functionally graded materials. First, the problem is transformed to a heat equation with constant coefficients using a suitable new transformation and then the MFS together with the Tikhonov regularization method is used to solve the resulting equation.
متن کاملStiffness-tolerant Methods for Transient Analysis of Stiff Markov Chains
-Three methods for numerical transient analysis of Markov chains, the modified Jensen's method (Jensen's method with steady-state detection of the underlying DTMC and computation of Poisson probabilities using the method of Fox and Glynn [1]), a third-order L-stable implicit Runge-Kutta method, and a second-order L-stable method, TR-BDF2, are compared. These methods are evaluated on the basis o...
متن کاملStochastic Dynamic Programming with Markov Chains for Optimal Sustainable Control of the Forest Sector with Continuous Cover Forestry
We present a stochastic dynamic programming approach with Markov chains for optimal control of the forest sector. The forest is managed via continuous cover forestry and the complete system is sustainable. Forest industry production, logistic solutions and harvest levels are optimized based on the sequentially revealed states of the markets. Adaptive full system optimization is necessary for co...
متن کاملAccelerated decomposition techniques for large discounted Markov decision processes
Many hierarchical techniques to solve large Markov decision processes (MDPs) are based on the partition of the state space into strongly connected components (SCCs) that can be classified into some levels. In each level, smaller problems named restricted MDPs are solved, and then these partial solutions are combined to obtain the global solution. In this paper, we first propose a novel algorith...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1989